Wearable terminal and method for controlling the same

ABSTRACT

A wearable terminal includes voice data generation unit a voice data generation unit configured to generate audio data, a sensing unit configured to sense a motion of a user&#39;s upper limb in a first axis direction perpendicular to a plane defined by a vertically downward oriented direction of the upper limb and a direction of movement of the user, and to generate motion data concerning the motion, a determination unit configured to determine, based on the motion data, whether or not the user is going to perform remote control of a home electric appliance, and a data processing unit configured to process the audio data. The data processing unit includes a transmission data generation unit configured to generate transmission data corresponding to the audio data if the determination unit determines that the user is going to perform the remote control, and a transmission unit configured to transmit the transmission data to a network.

This application is a reissue of U.S. Pat. No. 9,329,695, which issuedon May 3, 2016 from application Ser. No. 14/504,232, which claims thebenefit of U.S. Provisional Application No. 61/887,083, filed Oct. 4,2013.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present disclosure relates to a wearable terminal usable in a systemwhich allows remote control of home electric appliances via a network byusing voice instructions, and a method for controlling the wearableterminal.

2. Description of the Related Art

Recent advancements in communication technology enable remote control ofa home electric appliance by using voice instructions given by a user(see Japanese Unexamined Patent Application Publication No.2013-179446). According to Japanese Unexamined Patent ApplicationPublication No. 2013-179446 (hereinafter referred to as PatentLiterature 1), a user gives voice instructions to a control deviceconfigured to control home electric appliances. The control devicetransfers the voice instructions to a server. The server applies aspeech analysis process to the voice instructions, and generates acontrol signal for controlling a home electric appliance. The controlsignal is transmitted from the server to the home electric appliance.Accordingly, the home electric appliance can be operated in accordancewith the voice instructions given by the user.

Patent Literature 1 teaches that a smartphone is available as thecontrol device described above. A user often has a smartphone tucked ina bag. The user takes the smartphone out of the bag when using thesmartphone as the control device described above.

Patent Literature 1 also discloses a control device configured toprovide remote control of a home electric appliance by using a gestureinstead of using voice instructions. Patent Literature 1 teaches that awatch-type wearable terminal is available as the control device. Using awearable terminal as the control device described above allows a user togive gesture-based control instructions to the wearable terminal in realtime.

SUMMARY OF THE INVENTION

However, further improvements are needed in the technique disclosed inPatent Literature 1.

In one general aspect, the techniques disclosed here feature a wearableterminal configured to be wearable on an upper limb of a user and usablein a system for allowing remote control of a home electric appliance viaa network by using voice instructions. The wearable terminal includesvoice data generation unit a voice data generation unit configured togenerate audio data from the voice instructions, a sensing unitconfigured to sense a motion of the upper limb in a first axis directionperpendicular to a plane defined by a vertically downward orienteddirection of the upper limb and a direction of movement of the user, andto generate motion data concerning the motion, a determination unitconfigured to determine, based on the motion data, whether or not theuser is going to perform remote control of the home electric appliance,and a data processing unit configured to process the audio data. Thedata processing unit includes (i) a transmission data generation unitconfigured to generate transmission data corresponding to the audio datain a case where the determination unit determines that the user is goingto perform remote control of the home electric appliance, and (ii) atransmission unit configured to transmit the transmission data to thenetwork.

According to the aspect described above, the sensing unit generatesmotion data concerning a motion of a user's upper limb in a first axisdirection perpendicular to a plane defined by a vertically downwardoriented direction of the upper limb and a direction of movement of theuser. Thus, the determination unit may be able to accurately determinewhether or not the user is going to perform remote control of a homeelectric appliance. When the determination unit determines, based on themotion data, that the user is going to perform remote control of thehome electric appliance, the transmission data generation unit generatestransmission data corresponding to audio data. Accordingly, the remotecontrol of the home electric appliance may be achieved with accuracy andease.

These general and specific aspects may be implemented using a system, amethod, and a computer program, and any combination of systems, methods,and computer programs.

In an aspect, the present disclosure enables a user's easy and accurateremote control of home electric appliances.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of a wearable terminal according toa first embodiment;

FIG. 2 is a conceptual diagram of a three-dimensional coordinate systemthat is set for a user's upper limb;

FIG. 3 is a schematic flowchart of illustrative data processing of thewearable terminal illustrated in FIG. 1 (second embodiment);

FIG. 4 is a schematic block diagram of a wearable terminal according toa third embodiment;

FIG. 5 is a schematic flowchart of illustrative data processing of thewearable terminal illustrated in FIG. 4 (fourth embodiment);

FIG. 6 is a schematic block diagram of a wearable terminal according toa fifth embodiment;

FIG. 7 is a schematic flowchart of illustrative data processing of thewearable terminal illustrated in FIG. 6 (sixth embodiment);

FIG. 8 is a schematic block diagram of a wearable terminal according toa seventh embodiment;

FIG. 9 is a schematic block diagram of a wearable terminal according toan eighth embodiment;

FIG. 10 is a schematic block diagram of a wearable terminal according toa ninth embodiment;

FIG. 11 is a schematic block diagram of a wearable terminal according toa tenth embodiment;

FIG. 12 is a schematic flowchart of an illustrative operation of thewearable terminal illustrated in FIG. 11 (eleventh embodiment);

FIG. 13 is a conceptual diagram of a control system according to atwelfth embodiment;

FIG. 14 is a schematic block diagram of a wearable terminal according toa thirteenth embodiment;

FIG. 15 is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal illustrated in FIG. 14;

FIG. 16A is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal illustrated in FIG. 14 (fourteenthembodiment);

FIG. 16B is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal illustrated in FIG. 14 (fourteenthembodiment);

FIG. 17 is a schematic diagram illustrating communication devicesregistered in a cloud server as communication destinations of thewearable terminal illustrated in FIG. 14 (fifteenth embodiment);

FIG. 18 is a table showing priorities set in the cloud server (fifteenthembodiment);

FIG. 19 is a schematic block diagram of a wearable terminal according toa sixteenth embodiment;

FIG. 20A is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal illustrated in FIG. 19;

FIG. 20B is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal illustrated in FIG. 19;

FIG. 21 is a schematic block diagram of a wearable terminal according toa seventeenth embodiment;

FIG. 22 is a schematic diagram illustrating an illustrative useenvironment of a wearable terminal according to an eighteenthembodiment;

FIG. 23 is a table showing priorities set in a cloud server thatcommunicates with the wearable terminal illustrated in FIG. 22;

FIG. 24 is a schematic diagram illustrating home electric appliancesthat the user possesses (nineteenth embodiment);

FIG. 25 is a table showing priorities set in the cloud server; and

FIG. 26 is a table for associating targets to be controlled by the cloudserver with operations performed by the user (twentieth embodiment).

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Findings on which the present disclosure is based

The inventors have found that the technique disclosed in PatentLiterature 1 given above has the following difficulties.

In the technique disclosed in Patent Literature 1, when using a wearableterminal as a control device, a user has to give motions correspondingto the contents of control to the wearable terminal. To this end, theuser has to learn and memorize various motions representing the contentsof control.

In addition, the user may sometimes move the part of their body on whichthe wearable terminal is worn, for purposes other than the remotecontrol of a home electric appliance. Accordingly, the techniquedisclosed in Patent Literature 1 is likely to cause the wearableterminal to fail to work properly.

To address the problems described above, the inventors have developedthe following solution.

A first aspect of the present disclosure provides a wearable terminalconfigured to be wearable on an upper limb of a user and usable in asystem for allowing remote control of a home electric appliance via anetwork by using voice instructions. The wearable terminal includesvoice data generation unit a voice data generation unit configured togenerate audio data from the voice instructions, a sensing unitconfigured to sense a motion of the upper limb in a first axis directionperpendicular to a plane defined by a vertically downward orienteddirection of the upper limb and a direction of movement of the user, andto generate motion data concerning the motion, a determination unitconfigured to determine, based on the motion data, whether or not theuser is going to perform remote control of the home electric appliance,and a data processing unit configured to process the audio data. Thedata processing unit includes (i) a transmission data generation unitconfigured to generate transmission data corresponding to the audio datain a case where the determination unit determines that the user is goingto perform remote control of the home electric appliance, and (ii) atransmission unit configured to transmit the transmission data to thenetwork.

According to this aspect, the sensing unit generates motion dataconcerning a motion of a user's upper limb in a first axis directionperpendicular to a plane defined by a vertically downward orienteddirection of the upper limb and a direction of movement of the user.Thus, the determination unit may be able to accurately determine whetheror not the user is going to perform remote control of a home electricappliance. When the determination unit determines, based on the motiondata, that the user is going to perform remote control of the homeelectric appliance, the transmission data generation unit generatestransmission data corresponding to audio data. Accordingly, the remotecontrol of the home electric appliance may be achieved with accuracy andease.

In the first aspect, the motion data may indicate an acceleration of theupper limb in the first axis direction. When the acceleration is largerthan an acceleration threshold, the determination unit may determinethat the user is going to perform remote control of the home electricappliance.

According to this aspect, when the acceleration is larger than anacceleration threshold, the determination unit determines that the useris going to perform remote control. Thus, the remote control of the homeelectric appliance may be achieved with accuracy and ease.

In the first aspect, the sensing unit may be configured to sense anangular velocity of a rotational motion of the upper limb about a secondaxis extending in the vertically downward oriented direction of theupper limb, and to generate angular velocity data indicating the angularvelocity as the motion data. The determination unit may compare arotation angle of the upper limb calculated from the angular velocitydata with a rotation angle threshold, and determine that the user isgoing to perform remote control of the home electric appliance when therotation angle is larger than the rotation angle threshold.

According to this aspect, the determination unit determines whether ornot the user is going to perform remote control, by using not onlyacceleration but also using angular velocity. Thus, the remote controlof the home electric appliance may be achieved with accuracy and ease.

In the first aspect, the wearable terminal may further include a powersupply unit configured to supply power to the data processing unit. In acase where the determination unit determines that the user is going toperform remote control of the home electric appliance, the power supplyunit may start supplying the power to the data processing unit.

According to this aspect, in a case where the determination unitdetermines that the user is going to perform remote control, the powersupply unit starts supplying power to the data processing unit. Thus,the power consumption of the wearable terminal may be low.

A second aspect of the present disclosure provides a control methodsuitably used for a wearable terminal configured to be wearable on anupper limb of a user and usable in a system for allowing remote controlof a home electric appliance via a network by using voice instructions.The control method includes a sensing step of sensing a motion of theupper limb in a first axis direction perpendicular to a plane defined bya vertically downward oriented direction of the upper limb and adirection of movement of the user, and generating motion data concerningthe motion, a determination step of determining, based on the motiondata, whether or not the user is going to perform remote control of thehome electric appliance, a generation step of receiving the voiceinstructions and generating transmission data corresponding to the voiceinstructions in a case where it is determined in the determination stepthat the user is going to perform remote control of the home electricappliance, and a transmission step of transmitting the transmission datato the network.

According to this aspect, in the sensing step, motion data concerning amotion of a user's upper limb in a first axis direction perpendicular toa plane defined by a vertically downward oriented direction of the upperlimb and a direction of movement of the user is generated. Thus, in thedetermination step, it is accurately determined whether or not the useris going to perform remote control of a home electric appliance. When itis determined in the determination step that the user is going toperform remote control of the home electric appliance, in the generationstep, transmission data corresponding to voice instructions isgenerated. Thus, the remote control of the home electric appliance maybe achieved with accuracy and ease.

In the second aspect, the sensing step may include sensing anacceleration of the upper limb in the first axis direction. Thedetermination step may include comparing the acceleration with anacceleration threshold, and determining that the user is going toperform remote control of the home electric appliance when theacceleration is larger than the acceleration threshold.

According to this aspect, when the acceleration is larger than anacceleration threshold, in the determination step, it is determined thatthe user is going to perform remote control. Thus, the remote control ofthe home electric appliance may be achieved with accuracy and ease.

In the second aspect, the sensing step may include sensing an angularvelocity of a rotational motion of the upper limb about a second axisextending in the vertically downward oriented direction of the upperlimb. The determination step may include comparing a rotation angle ofthe upper limb calculated using the angular velocity with a rotationangle threshold, and determining that the user is going to performremote control of the home electric appliance if the rotation angle islarger than the rotation angle threshold.

According to this aspect, in the determination step, it is determinedwhether or not the user is going to perform remote control, by using notonly acceleration but also using angular velocity. Thus, the remotecontrol of the home electric appliance may be achieved with accuracy andease.

The above-described generic or specific aspects may be implemented by asystem, a method, an integrated circuit, a computer program, or acomputer-readable recording medium such as a compact disc read-onlymemory (CD-ROM), or may be implemented by any combination of a system, amethod, an integrated circuit, a computer program, and a recordingmedium.

In the following, some embodiments regarding a technique for control ofhome electrical devices using a wearable terminal will be described withreference to the accompanying drawings. The technique for controllinghome electrical devices using a wearable terminal will be apparentlyunderstood from the following description. Note that the directionassociated with the terms “up”, “down”, “left”, “right”, etc. is fordescriptive purposes only and is intended to be broadly construed.

First Embodiment

As described above, in existing control techniques using a wearableterminal, the content of the control to be performed on a home electricappliance is determined in accordance with a user gesture. This requiresa user to learn and memorize multiple gestures to request a homeelectric appliance to perform various operations.

In some cases, a wearable terminal may be moved without user's intentionto control a home electric appliance. The wearable terminal mayreciprocate back and forth when worn on the upper limb of the user. Ifone of the gestures described above is a back-and-forth reciprocatingmovement of a wearable terminal, the associated home electric appliancemay perform an operation that is not intended by the user.

The inventors have found the difficulties described above from therelated art, and have developed a wearable terminal that may provideeasy and accurate instruction to control a home electric appliance. In afirst embodiment, a design concept of a wearable terminal developed bythe inventors will be described.

FIG. 1 is a schematic block diagram of a wearable terminal 100 accordingto the first embodiment. The wearable terminal 100 will be describedwith reference to FIG. 1.

The wearable terminal 100 is worn on a user's upper limb. The term“upper limb”, as used herein, refers to a body portion of a userextending from the shoulder to the fingertip. The wearable terminal 100may be designed to be wearable on a user's wrist. Alternatively, thewearable terminal 100 may be designed to be wearable on a user's finger.The basic concept of this embodiment is not limited to a specificposition at which the wearable terminal 100 is worn.

When the wearable terminal 100 is designed to be wearable on a user'swrist, the wearable terminal 100 may look like a watch. When thewearable terminal 100 is designed to be wearable on a user's finger, thewearable terminal 100 may look like a ring. The designer of the wearableterminal 100 may determine the design of the wearable terminal 100 so asto be suitable for the position at which the wearable terminal 100 isworn. Accordingly, the basic concept of this embodiment is not limitedto a specific design of the wearable terminal 100.

The wearable terminal 100 is incorporated into a system that allowsremote control of a home electric appliance APL. When a user attempts totake remote control of the home electric appliance APL, the user givesvoice instructions to the wearable terminal 100. The wearable terminal100 converts audio from the user into an electrical signal. Theconverted signal is transmitted from the wearable terminal 100 to anetwork NTW. The network NTW generates a control signal for controllingthe home electric appliance APL in accordance with the converted signal.The control signal is transmitted from the network NTW to the homeelectric appliance APL. The home electric appliance APL executes apredetermined operation in accordance with the control signal.Alternatively, the home electric appliance APL stops its operation inaccordance with the control signal.

The signal transmitted from the wearable terminal 100 to the network NTWmay directly represent the audio of the user as it is. In this case, thenetwork NTW may identify the audio of the user from a signal from thewearable terminal 100 and determine the content of the operation thatthe user has requested the home electric appliance APL to perform. As aresult, the network NTW can generate a control signal indicating thecontent of the requested operation.

The wearable terminal 100 may extract a specific audio portion (e.g., anaudio segment representing a specific word that is necessary for acontrol signal) from the audio of the user. In this case, a signalindicating the extracted audio segment may be transmitted from thewearable terminal 100 to the network NTW. As a result, the network NTWcan determine the content of the operation that the user has requestedthe home electric appliance APL to perform, from the received signal,and generate a control signal indicating the content of the requestedoperation.

The wearable terminal 100 may have a function to identify the audio ofthe user. In this case, the wearable terminal 100 may be able togenerate a signal indicating the content of the operation that the userhas requested the home electric appliance APL to perform. The generatedsignal is transferred from the wearable terminal 100 to the homeelectric appliance APL via the network NTW.

As described above, the signal transmitted from the wearable terminal100 to the network NTW may represent various kinds of content.Accordingly, the basic concept of this embodiment is not limited to aspecific kind of content indicated by a signal transmitted from thewearable terminal 100 to the network NTW.

Various communication technologies that enable connection between thewearable terminal 100 and the home electric appliance APL so that thewearable terminal 100 and the home electric appliance APL cancommunicate with each other are applicable to the network NTW. Forexample, the network NTW may include a cloud server, a communicationnetwork over which the wearable terminal 100 is connected to the cloudserver so that the wearable terminal 100 and the cloud server cancommunicate with each other, and a communication network over which thecloud server is connected to the home electric appliance APL so that thecloud server and the home electric appliance APL can communicate witheach other. These communication paths may be based on various existingcommunication technologies. The basic concept of this embodiment is notlimited to a specific communication technology that is applied to thenetwork NTW.

The home electric appliance APL may be any of various devices which maybe used in general homes. Examples of the home electric appliance APLinclude a television set, a washing machine, an air conditioner, and acooker. The basic concept of this embodiment is not limited to aspecific type of home electric appliance APL.

The wearable terminal 100 includes voice data generation unit a voicedata generation unit 200, a sensing unit 300, a determination unit 400,and a data processing unit 500. The voice data generation unit 200generates audio data from voice instructions given by a user. Thesensing unit 300 senses a motion given to the wearable terminal 100 bythe user, and generates motion data indicating the motion. Thedetermination unit 400 determines, based on the motion data, whether ornot the user is going to take remote control of the home electricappliance APL. The data processing unit 500 processes the audio data.

Various devices capable of converting audio into an electrical signal(i.e., the audio data described above) are applicable to the voice datageneration unit 200. For example, a typical small microphone may be usedas the voice data generation unit 200. The basic concept of thisembodiment is not limited to a specific device used as the voice datageneration unit 200.

Various sensor devices capable of sensing a motion given to the wearableterminal 100 and generating an electrical signal indicating the motion(i.e., the motion data described above) are applicable to the sensingunit 300. The sensing unit 300 may be a typical acceleration sensor.Alternatively, the sensing unit 300 may be a typical angular velocitysensor. Alternatively, furthermore, the sensing unit 300 may be a sensordevice (e.g., a typical six-axis sensor) capable of detectingacceleration and angular velocity. The basic concept of this embodimentis not limited to a specific sensor device used as the sensing unit 300.

The determination unit 400 may be an electronic component and/or aprogram for performing a determination process based on motion data.When the sensing unit 300 is designed to detect the acceleration of thewearable terminal 100, the determination unit 400 may determine whetheror not the acceleration is larger than an acceleration threshold (athreshold predetermined for acceleration). If the acceleration is largerthan the acceleration threshold, the determination unit 400 maydetermine that the user is going to take remote control of the homeelectric appliance APL. When the sensing unit 300 is designed to detectthe angular velocity of the wearable terminal 100, the determinationunit 400 may apply an integration operation process to motion dataindicating the angular velocity. As a result, the determination unit 400can obtain data concerning the rotation angle of the wearable terminal100. The determination unit 400 may compare the calculated rotationangle with a rotation angle threshold (a threshold predetermined forrotation angle). If the rotation angle is larger than the rotation anglethreshold, the determination unit 400 may determine that the user isgoing to take remote control of the home electric appliance APL. Asdescribed above, the determination unit 400 may perform variousdetermination processes. Accordingly, the basic concept of thisembodiment is not limited to a specific determination process of thedetermination unit 400.

If the determination unit 400 determines that the user is going to takeremote control of the home electric appliance APL, the determinationunit 400 generates a trigger signal. The trigger signal is output fromthe determination unit 400 to the data processing unit 500. The dataprocessing unit 500 starts the processing of audio data in accordancewith the trigger signal.

The sensing unit 300 and the determination unit 400 may be formed as anintegrated circuit. In this case, the data processing unit 500 may beformed as another integrated circuit.

The sensing unit 300, the determination unit 400, and the dataprocessing unit 500 may be formed as a single integrated circuit.Alternatively, the sensing unit 300, the determination unit 400, and thedata processing unit 500 may be formed as separate circuits. The basicconcept of this embodiment is not limited to a specific circuitstructure of the sensing unit 300, the determination unit 400, and thedata processing unit 500.

The data processing unit 500 includes a transmission data generationunit 510 and a transmission unit 520. The audio data described above isoutput from the voice data generation unit 200 to the transmission datageneration unit 510. The trigger signal described above is output fromthe determination unit 400 to the transmission data generation unit 510.The transmission data generation unit 510 starts the processing of theaudio data in accordance with the trigger signal, and generatestransmission data corresponding to the audio data. The transmission datais output from the transmission data generation unit 510 to thetransmission unit 520. The transmission unit 520 transmits thetransmission data to the network NTW.

FIG. 2 is a conceptual diagram of a three-dimensional coordinate systemthat is set for the upper limb. A motion detection technique of thesensing unit 300 will be described with reference to FIG. 1 and FIG. 2.

The sensing unit 300 detects a motion of the upper limb in the directionof a first axis DVX. A coordinate axis extending along the extendedupper limb, from the shoulder to the fingertip, in the verticallydownward oriented direction of the upper limb is hereinafter referred toas a second axis PDX. A coordinate axis perpendicular to the second axisPDX and extending in the direction of movement of the user ishereinafter referred to as a third axis FBX. The first axis DVX isperpendicular to a coordinate plane defined by the second axis PDX andthe third axis FBX.

The sensing unit 300 detects a movement of the upper limb in theextending direction of the first axis DVX perpendicular to thecoordinate plane defined by the second axis PDX and the third axis FBX.A detection axis of a sensor used as the sensing unit 300 may beperpendicular to the coordinate plane defined by the second axis PDX andthe third axis FBX. In this case, the sensing unit 300 may be able toaccurately sense a motion (e.g., acceleration and/or angular velocity)in the direction extending along the first axis DVX. Alternatively, adetection axis of a sensor used as the sensing unit 300 may be inclinedat an angle larger than 0° and smaller than 90° with respect to thecoordinate plane defined by the second axis PDX and the third axis FBX.In this case, the sensing unit 300 can sense not only a motion in thedirection extending along the first axis DVX but also a motion in adirection extending along the coordinate plane defined by the secondaxis PDX and the third axis FBX. The determination unit 400 may apply apredetermined vector operation to the motion data output from thesensing unit 300, and individually evaluate the motion in the directionextending along the first axis DVX and the motion in the directionextending along the coordinate plane defined by the second axis PDX andthe third axis FBX. The basic concept of this embodiment is not limitedto a specific angle at which a detection axis of a sensor intersects thecoordinate plane defined by the second axis PDX and the third axis FBX.In this embodiment, a plane may be exemplified by the coordinate planedefined by the second axis PDX and the third axis FBX. The intersectiondirection may be exemplified by the direction of a detection axis of asensor used as the sensing unit 300.

While the user is walking, the upper limbs frequently move in thedirection indicated by the third axis FBX. When the user attempts topick up an object far in front of them, the upper limb is extended,causing the wearable terminal 100 to be likely to move in the directionindicated by the second axis PDX. When the user attempts to pick up anobject in front of their chest, the upper limb bends, causing thewearable terminal 100 to be likely to be move in the direction indicatedby the second axis PDX. The user's motions described above frequentlyoccur. By comparison with motions in the directions indicated by thethird axis FBX and the second axis PDX, the motion of the upper limb inthe direction indicated by the first axis DVX does not frequently occur.That is, the user does not usually move the upper limb quickly and/or alarge amount in the direction indicated by the first axis DVX.

When the sensing unit 300 senses a motion of the upper limb (i.e., thewearable terminal 100) in the direction indicated by the first axis DVX,the data processing unit 500 starts the processing of audio data. Thus,the processing of audio data is not likely to start in response to anaccidental or unintentional movement of the user. Accordingly, the homeelectric appliance APL may not be likely to be operated withoutintention.

Second Embodiment

The wearable terminal described in connection with the first embodimentmay operate under various forms of control. In a second embodiment, anillustrative operation of the wearable terminal will be described.

FIG. 3 is a schematic flowchart of illustrative data processing of thewearable terminal 100. Data processing in the wearable terminal 100 willbe described with reference to FIG. 1 to FIG. 3.

Step S110

In step S110, a sensing step is executed. In the sensing step, thesensing unit 300 senses a motion in the extending direction of the firstaxis DVX perpendicular to the coordinate plane defined by the secondaxis PDX and the third axis FBX. The sensing unit 300 generates motiondata indicating the motion in the extending direction of the first axisDVX. The motion data is output from the sensing unit 300 to thedetermination unit 400. After that, step S120 is executed.

Step S120

In step S120, a determination step is executed. In the determinationstep, the determination unit 400 determines, based on the motion data,whether or not the user is going to perform remote control of the homeelectric appliance APL. If the determination unit 400 determines thatthe user is going to perform remote control of the home electricappliance APL, step S130 is executed. Otherwise, step S110 is executed.

Step S130

In step S130, a generation step is executed. In the generation step, thevoice data generation unit 200 generates audio data indicating voiceinstructions from a user. The audio data is output from the voice datageneration unit 200 to the transmission data generation unit 510. Thedetermination unit 400 generates a trigger signal. The trigger signal isoutput from the determination unit 400 to the transmission datageneration unit 510. When the transmission data generation unit 510receives the trigger signal, the transmission data generation unit 510generates transmission data from the audio data. After that, step S140is executed.

Step S140

In step S140, a transmission step is executed. In the transmission step,the transmission data is output from the transmission data generationunit 510 to the transmission unit 520. The transmission unit 520transmits the transmission data to the network NTW.

Third Embodiment

In a design concept of the wearable terminal described in connectionwith the first embodiment, an acceleration sensor or angular velocitysensor having one detection axis may be used as a sensing unit. In thiscase, the sensing unit has low power consumption. However, a sensorelement (the acceleration sensor or angular velocity sensor) havingmultiple detection axes will not have an excessively high powerconsumption. Accordingly, a sensor element having a plurality ofdetection axes may be used for the detection of a motion of the upperlimb of the user. In this case, a determination unit may be able toaccurately determine how the upper limb of the user is moving, using themotion data output from the sensing unit. In a third embodiment, awearable terminal configured to be able to accurately determine whetheror not the user has requested remote control of a home electricappliance will be described.

FIG. 4 is a schematic block diagram of a wearable terminal 100Aaccording to the third embodiment. The wearable terminal 100A will bedescribed with reference to FIG. 2 and FIG. 4. Numerals common to thefirst embodiment and third embodiment designate components havingsubstantially the same features. Thus, these components are identifiedusing the description made in the first embodiment.

Similarly to the first embodiment, the wearable terminal 100A is worn onthe upper limb of the user. The wearable terminal 100A is incorporatedinto a system that allows remote control of the home electric applianceAPL. When the user attempts to take remote control of the home electricappliance APL, the user gives voice instructions to the wearableterminal 100A. The wearable terminal 100A converts audio from the userinto an electrical signal. The converted signal is transmitted from thewearable terminal 100A to the network NTW. The network NTW generates acontrol signal for controlling the home electric appliance APL inaccordance with the converted signal. The control signal is transmittedfrom the network NTW to the home electric appliance APL. The homeelectric appliance APL executes a predetermined operation in accordancewith the control signal. Alternatively, the home electric appliance APLstops its operation in accordance with the control signal.

Similarly to the first embodiment, the wearable terminal 100A includesvoice data generation unit a voice data generation unit 200 and a dataprocessing unit 500. These components are identified using thedescription made in the first embodiment.

The wearable terminal 100A further includes a sensing unit 300A and adetermination unit 400A. The sensing unit 300A generates motion dataindicating a motion of the upper limb. The motion data is output fromthe sensing unit 300A to the determination unit 400A. The determinationunit 400A determines, based on the motion data, whether or not the userhas requested remote control of a home electric appliance. If thedetermination unit 400A determines that the user has requested remotecontrol of a home electric appliance, the determination unit 400Agenerates a trigger signal. The trigger signal is output from thedetermination unit 400A to the transmission data generation unit 510.

The sensing unit 300A may be a sensor element having six detection axes.Three of the six detection axes may be used for the detection ofacceleration. The remaining detection axes may be used for the detectionof angular velocity. At least one of the six detection axes is used forthe sensing of a motion in a direction that intersects the coordinateplane defined by the second axis PDX and the third axis FBX.Accordingly, as described in connection with the first embodiment, thedetermination unit 400A may be able to accurately determine whether ornot the user has requested remote control of a home electric appliance.

The sensing unit 300A may be a sensor element having two to fivedetection axes. Alternatively, the sensing unit 300A may be a sensorelement having more than six detection axes. The basic concept of thisembodiment is not limited to a specific number of detection axes.

The determination unit 400A includes a pattern storage unit 410 and apattern analysis unit 420. The pattern storage unit 410 stores inadvance pattern data concerning motions of the upper limb before theuser makes voice instructions. The pattern data may be a pattern ofvariations in acceleration. Alternatively, the pattern data may be apattern of variations in angular velocity. The motion data is outputfrom the sensing unit 300A to the pattern analysis unit 420.

After the motion data is output from the sensing unit 300A to thepattern analysis unit 420, the pattern analysis unit 420 reads patterndata from the pattern storage unit 410. The pattern analysis unit 420compares the motion data with the pattern data.

If the motion data is similar or identical to the pattern data, thepattern analysis unit 420 may determine that the user has requestedremote control of the home electric appliance APL. In this case, thepattern analysis unit 420 generates a trigger signal. The trigger signalis output from the pattern analysis unit 420 to the transmission datageneration unit 510.

If the motion data is far different from the pattern data, the patternanalysis unit 420 may determine that the user has not requested remotecontrol of the home electric appliance APL. In this case, no triggersignal is output from the pattern analysis unit 420 to the transmissiondata generation unit 510. Thus, erroneous remote control of the homeelectric appliance APL may be prevented or at least reduced.

Fourth Embodiment

Setting a reference action for a motion of the upper limb may facilitatecomparison between motion data and pattern data. A trigger signal isgenerated if a motion of the upper limb which is subsequent to thereference action is similar or identical to the motion indicated by thepattern data, resulting in a reduction in the amount of pattern data tobe stored in a pattern storage unit. In a fourth embodiment,illustrative data processing in a wearable terminal will be described.

FIG. 5 is a schematic flowchart of illustrative data processing of thewearable terminal 100A. Data processing in the wearable terminal 100Awill be described with reference to FIG. 2 to FIG. 5. Numerals common tothe third embodiment and the fourth embodiment designate componentshaving substantially the same features. Thus, these components areidentified using the description made in the third embodiment.

As described in connection with the third embodiment, the sensing unit300A has a plurality of detection axes. One of the plurality ofdetection axes is used for the sensing of an acceleration in theextending direction of the first axis DVX perpendicular to thecoordinate plane defined by the second axis PDX and the third axis FBX.Thus, part of the motion data output from the sensing unit 300A canrepresent an acceleration in the extending direction of the first axisDVX. The other detection axes may be used for the sensing ofacceleration and/or angular velocity in other directions.

Step S210

In step S210, the sensing unit 300A senses a motion of the upper limb.After that, step S220 is executed.

Step S220

In step S220, the sensing unit 300A generates motion data indicating themotion of the upper limb. The motion data is output from the sensingunit 300A to the pattern analysis unit 420. After that, step S230 isexecuted. Step S210 and step S220 correspond to the sensing stepdescribed with reference to FIG. 3.

Step S230

In step S230, the pattern analysis unit 420 determines whether or notthe acceleration in the extending direction of the first axis DVX islarger than an acceleration threshold. If the acceleration in theextending direction of the first axis DVX is larger than theacceleration threshold, step S240 is executed. Otherwise, step S210 isexecuted.

Step S240

In step S240, the pattern analysis unit 420 reads pattern data from thepattern storage unit 410. The pattern analysis unit 420 compares motiondata, which is obtained at a point in time after the time at which anacceleration larger than the acceleration threshold occurred, with thepattern data. If the motion data is similar or identical to the patterndata, step S250 is executed. Otherwise, step S210 is executed.

Step S250

In step S250, the pattern analysis unit 420 generates a trigger signal.The trigger signal is output from the pattern analysis unit 420 to thetransmission data generation unit 510. Step S230 to step S250 correspondto the determination step described with reference to FIG. 3.

The user who is going to take remote control of the home electricappliance APL may abruptly move the upper limb in the extendingdirection of the first axis DVX. As a result, the processes of step S230and step S240 are executed.

The pattern data may indicate a motion of the upper limb which includesa movement of the upper limb in the extending direction of the firstaxis DVX and a movement of the upper limb toward the mouth of the user.When the user brings the wearable terminal 100A near their mouth afterhaving abruptly moved the upper limb in the extending direction of thefirst axis DVX step S250 is executed.

Fifth Embodiment

In a case where a sensing unit is configured to output motion dataindicating acceleration and motion data indicating angular velocity, adetermination unit may accurately determine whether or not the user hasrequested remote control of a home electric appliance. In a fifthembodiment, a wearable terminal configured to determine, using motiondata indicating acceleration and motion data indicating angularvelocity, whether or not the user has requested remote control of a homeelectric appliance will be described.

FIG. 6 is a schematic block diagram of a wearable terminal 100Baccording to the fifth embodiment. The wearable terminal 100B will bedescribed with reference to FIG. 2 and FIG. 6. Numerals common to thethird embodiment and the fifth embodiment designate components havingsubstantially the same features. Thus, these components are identifiedusing the description made in the third embodiment.

Similarly to the third embodiment, the wearable terminal 100B is worn onthe upper limb of the user. The wearable terminal 100B is incorporatedinto a system that allows remote control of the home electric applianceAPL. When the user attempts to take remote control of the home electricappliance APL, the user gives voice instructions to the wearableterminal 100B. The wearable terminal 100B converts audio from the userinto an electrical signal. The converted signal is transmitted from thewearable terminal 100B to the network NTW. The network NTW generates acontrol signal for controlling the home electric appliance APL inaccordance with the converted signal. The control signal is transmittedfrom the network NTW to the home electric appliance APL. The homeelectric appliance APL executes a predetermined operation in accordancewith the control signal. Alternatively, the home electric appliance APLstops its operation in accordance with the control signal.

Similarly to the third embodiment, the wearable terminal 100B includesvoice data generation unit a voice data generation unit 200 and a dataprocessing unit 500. These components are identified using thedescription made in the third embodiment.

The wearable terminal 100B further includes a sensing unit 300B and adetermination unit 400B. The sensing unit 300B includes an accelerationsensing unit 310 and an angular velocity sensing unit 320. Thedetermination unit 400B includes an acceleration determination unit 430,an integration unit 440, a rotation angle determination unit 450, and atrigger signal generation unit 460.

The acceleration sensing unit 310 has a detection axis for sensing anacceleration in the extending direction of the first axis DVX.Additionally, the acceleration sensing unit 310 may have a detectionaxis for sensing an acceleration in another direction.

The acceleration sensing unit 310 generates, as motion data,acceleration data indicating an acceleration in the extending directionof the first axis DVX. The acceleration data is output from theacceleration sensing unit 310 to the acceleration determination unit430. The acceleration determination unit 430 determines whether or notthe acceleration indicated by the acceleration data is larger than apredetermined acceleration threshold. If the acceleration indicated bythe acceleration data is larger than the predetermined accelerationthreshold, the acceleration sensing unit 310 generates a first triggersignal. The first trigger signal is output from the accelerationdetermination unit 430 to the trigger signal generation unit 460.

The angular velocity sensing unit 320 has a detection axis for sensingthe angular velocity of a rotational motion of the upper limb about thesecond axis PDX. Additionally, the angular velocity sensing unit 320 mayhave a detection axis for sensing angular velocity in another direction.

The angular velocity sensing unit 320 generates, as motion data, angularvelocity data indicating the angular velocity of a rotational motion ofthe upper limb about the second axis PDX. The angular velocity data isoutput from the angular velocity sensing unit 320 to the integrationunit 440. The integration unit 440 applies an integration process to theangular velocity data, and generates rotation angle data indicating therotation angle of the upper limb about the second axis PDX. The rotationangle data is output from the integration unit 440 to the rotation angledetermination unit 450. If the rotation angle indicated by the rotationangle data is larger than a predetermined rotation angle threshold, therotation angle determination unit 450 generates a second trigger signal.The second trigger signal is output from the rotation angledetermination unit 450 to the trigger signal generation unit 460.

Upon receipt of the first trigger signal and the second trigger signal,the trigger signal generation unit 460 generates a trigger signal. Thetrigger signal is output from the trigger signal generation unit 460 tothe transmission data generation unit 510.

The designer of the wearable terminal 100B may use a microphone as thevoice data generation unit 200. When the designer designs the wearableterminal 100B so that the wearable terminal 100B may be wearable on thewrist, the designer may arrange a sound collection unit of themicrophone at a position corresponding to the face (or dial) of a watch(i.e., a position near the back of the hand). When the designer designsthe wearable terminal 100B so that the wearable terminal 100B may bewearable on the finger, the designer may arrange a sound collection unitof the microphone at a position corresponding to a precious stone on aring (i.e., a position near the back of the hand). In the design of thearrangements described above, the user brings the sound collection unitof the microphone near their mouth by usually abruptly lifting up theupper limb in the extending direction of the first axis DVX and thenrotating the upper limb about the second axis PDX. If the user does notbring the sound collection unit of the microphone near their mouth, itis rare that the rotational motion of the upper limb about the secondaxis PDX occurs. Thus, the wearable terminal 100B may be less likely tocause erroneous remote control of the home electric appliance APL.

Sixth Embodiment

Setting a plurality of reference actions for a motion of the upper limbmay allow the determination unit to accurately determine whether or notthe user is going to take remote control of a home electric appliance.In a sixth embodiment, illustrative data processing in a wearableterminal configured to determine, using a plurality of referenceactions, whether or not the user is going to take remote control of ahome electric appliance will be described.

FIG. 7 is a schematic flowchart of illustrative data processing of thewearable terminal 100B. Data processing in the wearable terminal 100Bwill be described with reference to FIG. 2, FIG. 3, FIG. 6, and FIG. 7.Numerals common to the fifth embodiment and sixth embodiment designatecomponents having substantially the same features. Thus, thesecomponents are identified using the description made in the fifthembodiment.

Step S310

In step S310, the sensing unit 300B senses a motion of the upper limb.The acceleration sensing unit 310 senses an acceleration in theextending direction of the first axis DVX. The angular velocity sensingunit 320 senses the angular velocity of a rotational motion of the upperlimb about the second axis PDX. After that, step S320 is executed.

Step S320

In step S320, the sensing unit 300B generates motion data indicating themotion of the upper limb. The acceleration sensing unit 310 generates,as motion data, acceleration data indicating the acceleration in theextending direction of the first axis DVX. The acceleration data isoutput from the acceleration sensing unit 310 to the accelerationdetermination unit 430. The angular velocity sensing unit 320 generates,as motion data, angular velocity data indicating the angular velocity ofthe rotational motion of the upper limb about the second axis PDX. Theangular velocity data is output from the angular velocity sensing unit320 to the integration unit 440. After that, step S330 is executed. StepS310 and step S320 correspond to the sensing step described withreference to FIG. 3.

Step S330

In step S330, the acceleration determination unit 430 determines whetheror not the acceleration indicated by the acceleration data is largerthan an acceleration threshold. If the acceleration is larger than theacceleration threshold, the acceleration determination unit 430generates a first trigger signal. The first trigger signal is outputfrom the acceleration determination unit 430 to the trigger signalgeneration unit 460. After that, step S340 is executed. If theacceleration is not larger than the acceleration threshold, step S310 isexecuted.

Step S340

In step S340, the integration unit 440 performs an integration operationprocess on the angular velocity data, and calculates a rotation angle.Rotation angle data indicating the calculated rotation angle is outputto the rotation angle determination unit 450. After that, step S350 isexecuted.

Step S350

In step S350, the rotation angle determination unit 450 determineswhether or not the rotation angle indicated by the rotation angle datais larger than a rotation angle threshold. If the rotation angle islarger than the rotation angle threshold, the rotation angledetermination unit 450 generates a second trigger signal. The secondtrigger signal is output from the rotation angle determination unit 450to the trigger signal generation unit 460. After that, step S360 isexecuted. If the rotation angle is not larger than the rotation anglethreshold, step S310 is executed. The processes of step S330 to stepS350 correspond to the determination step described with reference toFIG. 3.

Step S360

In step S360, the trigger signal generation unit 460 generates a triggersignal. The trigger signal is output from the trigger signal generationunit 460 to the transmission data generation unit 510.

The user who is going to take remote control of the home electricappliance APL first abruptly moves the upper limb in the extendingdirection of the first axis DVX. Consequently, the processes of stepS310 to step S330 are sequentially executed.

The user then rotates the upper limb about the second axis PDX.Consequently, the processes of step S340 to step S360 are sequentiallyexecuted.

It is unusual that a quick motion of the upper limb in the extendingdirection of the first axis DVX and a rotational motion of the upperlimb about the second axis PDX occur by chance in combination. Thus, thewearable terminal 100B may be less likely to cause erroneous remotecontrol of the home electric appliance APL.

Seventh Embodiment

In general, sensor elements have low power consumption. In contrast, thetransmission of data to a network requires high power consumption. Thus,constant supply of power to an electronic component that is responsiblefor data transmission to a network is not desirable for wearableterminals. In a seventh embodiment, a design concept of a wearableterminal that requires low power consumption will be described.

FIG. 8 is a schematic block diagram of a wearable terminal 100Caccording to the seventh embodiment. The wearable terminal 100C will bedescribed with reference to FIG. 1, FIG. 4, FIG. 6, and FIG. 8.

The wearable terminal 100C includes a first integrated circuit 110, asecond integrated circuit 120, a microphone 200C, an antenna unit 521,and a power supply unit 600. The microphone 200C converts audio from theuser into an electrical signal (audio data). Accordingly, the microphone200C corresponds to the voice data generation unit 200 described withreference to FIG. 1, FIG. 4, or FIG. 6. The antenna unit 521 is used totransmit transmission data to a network (not illustrated). Accordingly,the antenna unit 521 corresponds to part of the transmission unit 520described with reference to FIG. 1, FIG. 4, or FIG. 6.

The first integrated circuit 110 includes a motion sensor 300C and anoperation determination unit 400C. The motion sensor 300C is configuredto sense a motion of the upper limb on which the wearable terminal 100Cis worn. Accordingly, the motion sensor 300C may correspond to one ofthe sensing units 300, 300A, and 300B described with reference to FIG.1, FIG. 4, and FIG. 6. Similarly to the sensing units 300, 300A, and300B, the motion sensor 300C generates motion data indicating a motionof the upper limb. The motion data is output from the motion sensor 300Cto the operation determination unit 400C.

The operation determination unit 400C analyzes the motion data, anddetermines whether or not the user is going to take remote control of ahome electric appliance (not illustrated). Accordingly, the operationdetermination unit 400C may correspond to one of the determination units400, 400A, and 400B described with reference to FIG. 1, FIG. 4, and FIG.6. The operation determination unit 400C may have a function to, inaddition to the function of the determination units 400, 400A, and 400Bdescribed with reference to FIG. 1, FIG. 4, and FIG. 6, learn a motionof the upper limb that the user performs when taking remote control of ahome electric appliance. Similarly to the determination units 400, 400A,and 400B, when determining that the user is going to take remote controlof a home electric appliance, the operation determination unit 400Cgenerates a trigger signal. The trigger signal is output from theoperation determination unit 400C to the second integrated circuit 120and the power supply unit 600.

The power supply unit 600 may constantly supply power to the firstintegrated circuit 110 that is responsible for the sensing and analysisof a motion of the upper limb. On the other hand, the power supply unit600 does not supply power to the second integrated circuit 120, which isresponsible for communication with a network, when the power supply unit600 does not receive the trigger signal. When the power supply unit 600receives the trigger signal, the power supply unit 600 starts supplyingpower to the second integrated circuit 120. Thus, unnecessary powerconsumption may be prevented or at least reduced.

When the second integrated circuit 120 receives the trigger signal fromthe operation determination unit 400C and the second integrated circuit120 receives power supply from the power supply unit 600, the secondintegrated circuit 120 executes data processing to convert the audiodata received from the microphone 200C into transmission data.Accordingly, the second integrated circuit 120 corresponds to the dataprocessing unit 500 described with reference to FIG. 1, FIG. 4, or FIG.6.

The second integrated circuit 120 includes a control unit 121, an I/Osection 122, an encoding unit 510C, and a transmission unit 522. Thecontrol unit 121 executes overall control regarding data processing inthe second integrated circuit 120. Accordingly, the I/O section 122, theencoding unit 510C, and the transmission unit 522 operate under controlof the control unit 121.

The microphone 200C may receive power via the I/O section 122. Thus, themicrophone 200C does not consume power before the operationdetermination unit 400C generates a trigger signal. Thus, unnecessarypower consumption may be prevented or at least reduced.

As described above, the microphone 200C converts voice instructions fromthe user into audio data. The audio data is output from the microphone200C to the I/O section 122. The I/O section 122 outputs the audio datato the encoding unit 510C under control of the control unit 121.

The encoding unit 510C encodes the audio data and generates transmissiondata under control of the control unit 121. The transmission data isoutput from the encoding unit 510C to the transmission unit 522. Theencoding unit 510C and the control unit 121 correspond to thetransmission data generation unit 510 described with reference to FIG.1, FIG. 4, or FIG. 6.

The transmission unit 522 outputs the transmission data under control ofthe control unit 121. The transmission data is transmitted to a networkvia the antenna unit 521. The transmission unit 522 may be acommunication element used for near field communication (e.g.,Bluetooth). As a result, power consumption of the transmission unit 522is set to low. The transmission unit 522, the antenna unit 521, and thecontrol unit 121 correspond to the transmission unit 520 described withreference to FIG. 1, FIG. 4, or FIG. 6.

Eighth Embodiment

In terms of low power consumption, it is desirable that power supply toa second integrated circuit be stopped after the user inputs voiceinstructions to a wearable terminal. The user may manually input thecompletion of voice instructions to the wearable terminal. However, ifthe user forgets to give instructions to stop power supply, power willbe continuously supplied to the second integrated circuit. Thus,preferably, power supply to the second integrated circuit isautomatically stopped. In an eighth embodiment, a wearable terminalconfigured to automatically stop supplying power to the secondintegrated circuit will be described.

FIG. 9 is a schematic block diagram of a wearable terminal 100Daccording to the eighth embodiment. The wearable terminal 100D will bedescribed with reference to FIG. 1, FIG. 4, FIG. 6, and FIG. 9. Numeralscommon to the seventh embodiment and the eighth embodiment designatecomponents having substantially the same features. Thus, thesecomponents are identified using the description made in the seventhembodiment.

Similarly to the seventh embodiment, the wearable terminal 100D includesa first integrated circuit 110, a microphone 200C, and an antenna unit521. These components are identified using the description made in theseventh embodiment.

The wearable terminal 100D further includes a second integrated circuit120D and a power supply unit 600D. The power supply unit 600D mayconstantly supply power to the first integrated circuit 110 that isresponsible for the sensing and analysis of a motion of the upper limb.On the other hand, the power supply unit 600D does not supply power tothe second integrated circuit 120D, which is responsible forcommunication with a network, when the power supply unit 600D does notreceive the trigger signal. When the power supply unit 600D receives thetrigger signal, the power supply unit 600D starts supplying power to thesecond integrated circuit 120D.

When the second integrated circuit 120D receives the trigger signal fromthe operation determination unit 400C and the second integrated circuit120D receives power supply from the power supply unit 600D, the secondintegrated circuit 120D executes data processing to convert the audiodata received from the microphone 200C into transmission data.Accordingly, the second integrated circuit 120D corresponds to the dataprocessing unit 500 described with reference to FIG. 1, FIG. 4, or FIG.6.

Similarly to the seventh embodiment, the second integrated circuit 120Dincludes an I/O section 122, an encoding unit 510C, and a transmissionunit 522. These components are identified using the description made inthe seventh embodiment.

The second integrated circuit 120D further includes a control unit 121Dand a timer 123. The control unit 121D executes overall controlregarding data processing in the second integrated circuit 120D.Accordingly, the I/O section 122, the timer 123, the encoding unit 510C,and the transmission unit 522 operate under control of the control unit121D.

When the power supply unit 600D receives the trigger signal from theoperation determination unit 400C, the power supply unit 600D generatesa request signal for requesting the timer 123 to start operating. Therequest signal is output from the power supply unit 600D to the controlunit 121D substantially in synchronization with the start of powersupply from the power supply unit 600D to the second integrated circuit120D. The control unit 121D starts the operation of the timer 123 inaccordance with the request signal.

An input period necessary for audio input is preset in the timer 123.When the input period elapses from the time at which the timer 123starts its operation, the timer 123 notifies the control unit 121D ofthe completion of the input period. In response to the notification fromthe timer 123, the control unit 121D generates a control signal forproviding instruction to stop power supply. The control signal is outputfrom the control unit 121D to the power supply unit 600D.

The power supply unit 600D stops supplying power to the secondintegrated circuit 120D in accordance with the control signal from thecontrol unit 121D. This may prevent or reduce unnecessary powerconsumption of the second integrated circuit 120D after audio is input.

Ninth Embodiment

A wearable terminal may have a user interface function to presentinformation to a user and to receive input from the user. A wearableterminal capable of presenting information useful for users will beeffective in use. For example, a wearable terminal that displays theprogress of the processing of voice instructions will allow a user tocheck whether or not audio has been appropriately input. A wearableterminal that receives other input in addition to voice instructionsfrom a user will be able to have a wide range of functions. For example,a wearable terminal that receives manual input of a user will allow theuser to perform various operations such as setting a communication pathof data transmitted from the wearable terminal and setting prioritiesfor home electric appliances to be controlled. In a ninth embodiment, awearable terminal having a user interface function will be described.

FIG. 10 is a schematic block diagram of a wearable terminal 100Eaccording to the ninth embodiment. The wearable terminal 100E will bedescribed with reference to FIG. 1, FIG. 4, FIG. 6, and FIG. 10.Numerals common to the eighth embodiment and the ninth embodimentdesignate components having substantially the same features. Thus, thesecomponents are identified using the description made in the eighthembodiment.

Similarly to the eighth embodiment, the wearable terminal 100E includesa first integrated circuit 110, a microphone 200C, and an antenna unit521. These components are identified using the description made in theeighth embodiment.

The wearable terminal 100E further includes a second integrated circuit120E, a user interface 130, and a power supply unit 600E. The powersupply unit 600E may constantly supply power to the first integratedcircuit 110 that is responsible for the sensing and analysis of a motionof the upper limb. On the other hand, the power supply unit 600E doesnot supply power to the second integrated circuit 120E or the userinterface 130 when the power supply unit 600E does not receive thetrigger signal. When the power supply unit 600E receives the triggersignal, the power supply unit 600E starts supplying power to the secondintegrated circuit 120E and the user interface 130.

When the second integrated circuit 120E receives the trigger signal fromthe operation determination unit 400C and the second integrated circuit120E receives power supply from the power supply unit 600E, the secondintegrated circuit 120E executes data processing to convert the audiodata received by the microphone 200C into transmission data.Accordingly, the second integrated circuit 120E corresponds to the dataprocessing unit 500 described with reference to FIG. 1, FIG. 4, or FIG.6.

Similarly to the eighth embodiment, the second integrated circuit 120Eincludes a timer 123, an encoding unit 510C, and a transmission unit522. These components are identified using the description made in theeighth embodiment.

The second integrated circuit 120E further includes a control unit 121Eand an I/O section 122E. The control unit 121E executes overall controlregarding data processing in the second integrated circuit 120E.Accordingly, the I/O section 122E, the timer 123, the encoding unit510C, and the transmission unit 522 operate under control of the controlunit 121E.

When the power supply unit 600E receives the trigger signal from theoperation determination unit 400C, the power supply unit 600E generatesa request signal for requesting the timer 123 to start operating. Therequest signal is output from the power supply unit 600E to the controlunit 121E substantially in synchronization with the start of powersupply from the power supply unit 600E to the second integrated circuit120E. The control unit 121E starts the operation of the timer 123 inaccordance with the request signal.

After the timer 123 starts its operation, the control unit 121E maygenerate display data indicating various pieces of information. Thedisplay data is output from the control unit 121E to the user interface130 via the I/O section 122E. For example, the display data may indicatethat the wearable terminal 100E becomes available to receive voiceinstructions. Alternatively, the display data may indicate a period upto the completion of voice instructions. Alternatively, furthermore, thedisplay data may indicate other information useful for the user. Thebasic concept of this embodiment is not limited to a specific piece ofinformation indicated by display data.

The user interface 130 includes a display 131 and a touch panel 132. Thedisplay 131 displays information indicated by the display data generatedby the control unit 121E. This allows the user to visually acquireinformation provided from the wearable terminal 100E.

The user can operate the touch panel 132 to input various pieces ofinformation to the wearable terminal 100E. The information input by theuser through the touch panel 132 is output to the control unit 121E viathe I/O section 122E. The control unit 121E may generate various controlsignals in accordance with the input information from the user. Thevarious control signals may be output to a network via the transmissionunit 522 and the antenna unit 521. The basic concept of this embodimentis not limited to the specific content of the input information orspecific controlled content defined by the control signal.

Tenth Embodiment

A wearable terminal is not always worn on the upper limb. If the userleaves the wearable terminal after removing it from the upper limb,someone may find the wearable terminal and pick it up. If a third partyoperates the wearable terminal, a home electric appliance may perform anunwanted operation. It is therefore desirable that only an authorizeduser be permitted to operate the wearable terminal. In a tenthembodiment, a wearable terminal having an authentication function toverify the authenticity of the user will be described.

FIG. 11 is a schematic block diagram of a wearable terminal 100Faccording to the tenth embodiment. The wearable terminal 100F will bedescribed with reference to FIG. 1, FIG. 4, FIG. 6, and FIG. 11.Numerals common to the ninth embodiment and the tenth embodimentdesignate components having substantially the same features. Thus, Thesecomponents are identified using the description made in the ninthembodiment.

Similarly to the ninth embodiment, the wearable terminal 100F includes afirst integrated circuit 110, a user interface 130, a microphone 200C,and an antenna unit 521. These components are identified using thedescription made in the ninth embodiment.

The wearable terminal 100F further includes a second integrated circuit120F, a power supply unit 600F, and a power button 610. When the useroperates the power button 610 and requests the wearable terminal 100F tostart operating, the power supply unit 600F starts supplying power tothe first integrated circuit 110, the second integrated circuit 120F,and the user interface 130. Power is continuously supplied from thepower supply unit 600F to the first integrated circuit 110 until theuser operates the power button 610 and makes a request to stop powersupply from the power supply unit 600F to the first integrated circuit110.

Similarly to the ninth embodiment, the second integrated circuit 120Fincludes an I/O section 122E, a timer 123, an encoding unit 510C, and atransmission unit 522. These components are identified using thedescription made in the ninth embodiment.

The second integrated circuit 120F further includes a control unit 121F,a storage unit 124, and an authentication unit 125. The control unit121F executes overall control regarding data processing in the secondintegrated circuit 120F. Accordingly, the I/O section 122E, the timer123, the storage unit 124, the authentication unit 125, the encodingunit 510C, and the transmission unit 522 operate under control of thecontrol unit 121F.

The control unit 121F may generate display data to request the user toenter a password. The display data is output from the control unit 121Fto the display 131 via the I/O section 122E. As a result, the display131 displays an image to request the user to enter a password.

In response to the password request image on the display 131, the useroperates the touch panel 132 and enters a password. Authenticationinformation indicating the entered password is output from the touchpanel 132 to the I/O section 122E. The I/O section 122E outputs theauthentication information to the authentication unit 125 under controlof the control unit 121F.

The storage unit 124 stores a password preset by the user. Upon receiptof the authentication information, the authentication unit 125 reads thepassword from the storage unit 124. After that, the authentication unit125 compares the authentication information with the read password.

If the authentication information matches the read password, theauthentication unit 125 notifies the control unit 121F of successfulcompletion of the authentication. Then, the control unit 121F maygenerate display data indicating that the authentication has beensuccessfully completed. The display data is output from the control unit121F to the display 131 via the I/O section 122E. As a result, thedisplay 131 displays an image indicating successful completion of theauthentication process.

If the authentication information does not match the read password, theauthentication unit 125 notifies the control unit 121F that theauthentication has failed. Then, the control unit 121F may generatedisplay data to prompt the user to re-enter a password and/or to promptinterruption of authentication. The display data is output from thecontrol unit 121F to the display 131 via the I/O section 122E. As aresult, the display 131 displays an image to prompt the user to re-entera password and/or prompt interruption of authentication. In response tothe displayed image, the user operates the touch panel 132 and re-entersa password. Alternatively, in response to the displayed image, the useroperates the touch panel 132 and requests the wearable terminal 100F tointerrupt the authentication process. The request for the interruptionof the authentication process, which is input via the touch panel 132,is output from the touch panel 132 to the control unit 121F via the I/Osection 122E.

After display data indicating the completion of the authentication isoutput to the display 131 or after the control unit 121F receives therequest for the interruption of the authentication process, the controlunit 121F generates a control signal for requesting that power supply bestopped. The control signal is output from the control unit 121F to thepower supply unit 600F. As a result, the power supply unit 600F stopssupplying power to the second integrated circuit 120F and the userinterface 130 while continuously supplying power to the first integratedcircuit 110.

After that, when the user gives a predetermined motion to the upperlimb, the operation determination unit 400C generates a trigger signal.The trigger signal is output from the operation determination unit 400Cto the second integrated circuit 120F and the power supply unit 600F.When the power supply unit 600F receives the trigger signal, the powersupply unit 600F resumes supplying power to the second integratedcircuit 120F and the user interface 130.

When the power supply unit 600F receives the trigger signal from theoperation determination unit 400C, the power supply unit 600F generatesa request signal for requesting the timer 123 to start operating. Therequest signal is output from the power supply unit 600F to the controlunit 121F substantially in synchronization with the start of powersupply from the power supply unit 600F to the second integrated circuit120F. The control unit 121F starts the operation of the timer 123 inaccordance with the request signal.

When the second integrated circuit 120F receives the trigger signal fromthe operation determination unit 400C and the second integrated circuit120F receives power supply from the power supply unit 600F, the secondintegrated circuit 120F executes data processing to convert the audiodata received from the microphone 200C into transmission data.Accordingly, the second integrated circuit 120F corresponds to the dataprocessing unit 500 described with reference to FIG. 1, FIG. 4, or FIG.6.

If user authentication is successful, the result of the userauthentication may be kept valid until the wearable terminal 100F isremoved from the upper limb. This may avoid inconveniencing the userwith frequent authentication operations in the manner described above.

The wearable terminal 100F starts the authentication process in responseto the operation of the power button 610. Alternatively, theauthentication process may be started when the wearable terminal 100F isworn on the upper limb. Accordingly, the basic concept of thisembodiment is not limited to a specific operation to start theauthentication process.

The wearable terminal 100F uses a password for user authentication.Alternatively, any other authentication technique may be used for userauthentication. Biometric authentication techniques such as a voiceprint authentication technique, a fingerprint authentication technique,and an iris authentication technique may be used for userauthentication. Alternatively, a blood pressure measurement technique ora pulse measurement technique may be used for user authentication. Bycomparing a blood pressure measured in the authentication process and/ora pulse rate measured in the authentication process with previousmeasurement data of blood pressure or pulse rate, a wearable terminalcan determine whether or not a person who is going to use the wearableterminal is an authorized user. Accordingly, the basic concept of thisembodiment is not limited to any specific authentication technique.

Eleventh Embodiment

The wearable terminal described in connection with the tenth embodimentis configured to execute various operations. In an eleventh embodiment,an illustrative operation of the wearable terminal will be described.

FIG. 12 is a schematic flowchart of an illustrative operation of thewearable terminal 100F. The operation performed in the wearable terminal100F will be described with reference to FIG. 3, FIG. 5, FIG. 7, FIG.11, and FIG. 12.

Step S405

In step S405, the user operates the power button 610, and requests thewearable terminal 100F to start operating. Step S405 is continuouslyperformed until the user requests the wearable terminal 100F to startoperating. When the user requests the wearable terminal 100F to startoperating, step S410 is executed.

Step S410

In step S410, the power supply unit 600F starts supplying power to thefirst integrated circuit 110, the second integrated circuit 120F, andthe user interface 130. After that, step S415 is executed.

Step S415

In step S415, the authentication process described in connection withthe tenth embodiment is performed. If the wearable terminal 100Fsuccessfully authenticates the user, step S420 is executed.

Step S420

In step S420, the power supply unit 600F stops supplying power to thesecond integrated circuit 120F and the user interface 130. On the otherhand, the power supply unit 600F continuously supplies power to thefirst integrated circuit 110. After that, step S425 is executed.

Step S425

In step S425, the operation determination unit 400C determines whetheror not the user has requested remote control of a home electricappliance. That is, in step S425, the determination step described withreference to FIG. 3 is executed. As described with reference to FIG. 5,in the determination step, an acceleration may be compared with anacceleration threshold (step S230 of FIG. 5). Additionally, motion dataobtained from the motion sensor 300C may be compared with pattern datastored in advance (step S240 of FIG. 5). Alternatively, as describedwith reference to FIG. 7, in the determination step, comparison betweena rotation angle and a rotation angle threshold may be performed (stepS350 of FIG. 7). The basic concept of this embodiment is not limited toa specific determination technique.

If the operation determination unit 400C determines that the user hasnot requested remote control of a home electric appliance, step S430 isexecuted. If the operation determination unit 400C determines that theuser has requested remote control of a home electric appliance, stepS435 is executed.

Step S430

In step S430, the power supply unit 600F determines whether or not theuser has operated the power button 610 to stop power supply. If the userhas operated the power button 610 to stop power supply, the wearableterminal 100F ends the operation. Otherwise, step S425 is executed.

Step S435

In step S435, the operation determination unit 400C generates a triggersignal. The trigger signal is output from the operation determinationunit 400C to the power supply unit 600F and the control unit 121F. Thepower supply unit 600F resumes supplying power to the second integratedcircuit 120F and the user interface 130 in accordance with the triggersignal. The control unit 121F starts the operation of the timer 123 inaccordance with the trigger signal. After that, step S440 is executed.

Step S440

In step S440, the user gives voice instructions to the wearable terminal100F to control a home electric appliance. The voice instructions areconverted into an electrical signal (audio data) by the microphone 200C.The audio data is output to the encoding unit 510C via the I/O section122E. After that, step S445 is executed.

Step S445

In step S445, the control unit 121F determines whether or not an inputperiod preset for audio input has been completed. If the control unit121F receives a notification of the completion of the input period fromthe timer 123, step S450 is executed. Alternatively, the control unit121F may receive a notification indicating that an encoding process iscompleted from the encoding unit 510C. Also in this case, step S450 isexecuted. Otherwise, step S435 is executed.

Step S450

In step S450, the encoding unit 510C encodes the audio data, andgenerates transmission data. The transmission data is output from theencoding unit 510C to the transmission unit 522. After that, step S455is executed.

Step S455

In step S455, the transmission unit 522 transmits the transmission datafrom the antenna unit 521. After that, step S460 is executed.

Step S460

In step S460, the power supply unit 600F determines whether or not theuser has operated the power button 610 to stop power supply. If the userhas operated the power button 610 to stop power supply, the wearableterminal 100F ends the operation. Otherwise, step S420 is executed.

Twelfth Embodiment

A wearable terminal is configured to be wearable on the upper limb of auser. A communication device that the user carries relays transmissiondata generated by the wearable terminal, allowing a reduction in powerconsumption of the wearable terminal to transmit the transmission data.In a twelfth embodiment, a communication technology that does not causeexcessive power consumption of a wearable terminal will be described.

FIG. 13 is a conceptual diagram of a control system 700 according to thetwelfth embodiment. The control system 700 will be described withreference to FIG. 1, FIG. 4, FIG. 6, FIG. 8 to FIG. 11, and FIG. 13.

The control system 700 controls various home electric appliances. FIG.13 illustrates home electric appliances including a television set AP1,an air conditioner AP2, and a washing machine AP3. The basic concept ofthis embodiment is not limited to a specific home electric appliancecontrolled by the control system 700.

The control system 700 includes a wearable terminal 101, a smartphone710, a home gateway 720, and a cloud server 730. The wearable terminal101 may be one of the wearable terminals 100, 100A, 100B, 100C, 100D,100E, and 100F described with reference to FIG. 1, FIG. 4, FIG. 6, andFIG. 8 to FIG. 11. The wearable terminal 101 is worn on the wrist of auser who stays outdoors. Alternatively, the wearable terminal 101 may beworn on any other portion of the upper limb of the user (e.g., thefinger). The basic concept of this embodiment is not limited to aspecific position at which a wearable terminal is worn.

Both the wearable terminal 101 and the smartphone 710 are communicationdevices that the user carries, and the wearable terminal 101 is capableof transmitting transmission data indicating voice instructions from theuser to the smartphone 710 using near field communication technologysuch as Bluetooth. Thus, the wearable terminal 101 does not requireexcessively high power consumption to transmit transmission data.

The smartphone 710 is capable of communicating with the cloud server 730via a base station (not illustrated) using a radio communicationtechnology (e.g., wideband code division multiple access (W-CDMA) orlong term evolution (LTE)) with wide coverage. The communication betweenthe smartphone 710 and the cloud server 730 may be based on variousexisting communication technologies. Accordingly, the basic concept ofthis embodiment is not limited to a specific communication technologyused for communication between the smartphone 710 and the cloud server730.

The transmission data generated by the wearable terminal 101 istransmitted to the cloud server 730 via the smartphone 710. When thecloud server 730 receives the transmission data, the cloud server 730applies a decoding process to the transmission data. After that, thecloud server 730 analyzes the decoded transmission data. The cloudserver 730 may use various speech recognition techniques for theanalysis of the transmission data. The basic concept of this embodimentis not limited to a specific speech recognition technique.

The cloud server 730 generates control data based on the result of theanalysis of the transmission data. The control data may includeinformation concerning a home electric appliance to be controlled whichis specified by the voice instructions made by the user, and otherinformation necessary for the content of control that is specified bythe voice instructions made by the user or necessary to control the homeelectric appliance. For example, when the user gives voice instructionsto the wearable terminal 101 to “operate the air conditioner at a settemperature of 25° C.”, the control data generated by the cloud server730 designates “the air conditioner AP2” as the target of control, andspecifies the “operation at a set temperature of 25° C.” as the contentof the control.

The control data is transmitted from the cloud server 730 to the homegateway 720. The home gateway 720 transfers the control data to the homeelectric appliance specified by the control data. As described above, ifthe control data specifies “the air conditioner AP2”, the home gateway720 transfers the control data to the air conditioner AP2. If thecontrol data specifies the “operation at a set temperature of 25° C.”,the air conditioner AP2 operates at a set temperature of 25° C.

Thirteenth Embodiment

A wearable terminal may be configured to receive a radio wave outputfrom any other mobile terminal or a radio wave output from a homeelectric appliance. In this case, wearable terminal may provideinformation concerning the received radio wave to a network. As aresult, an appropriate communication path is set for transmission datato be output from the wearable terminal. In a thirteenth embodiment, awearable terminal configured to receive a radio wave output from anyother mobile terminal or a radio wave output from a home electricappliance will be described.

FIG. 14 is a schematic block diagram of a wearable terminal 100Gaccording to the thirteenth embodiment. The wearable terminal 100G willbe described with reference to FIG. 14. Numerals common to the tenthembodiment and the thirteenth embodiment designate components havingsubstantially the same features. Thus, these components are identifiedusing the description made in the tenth embodiment.

Similarly to the tenth embodiment, the wearable terminal 100G includes afirst integrated circuit 110, a user interface 130, a microphone 200C,an antenna unit 521, a power supply unit 600F, and a power button 610.These components are identified using the description made in the tenthembodiment.

The wearable terminal 100G further includes a second integrated circuit120G. Similarly to the tenth embodiment, the second integrated circuit120G executes processes such as generation of transmission data, controlof the user interface 130, and user authentication. The processingoperation described in connection with the tenth embodiment is used toindicate the operation of the second integrated circuit 120G.

Similarly to the tenth embodiment, the second integrated circuit 120Gincludes an I/O section 122E, a timer 123, a storage unit 124, anauthentication unit 125, and an encoding unit 510C. These components areidentified using the description made in the tenth embodiment.

The second integrated circuit 120G further includes a control unit 121Gand a communication unit 522G. Similarly to the tenth embodiment, thecommunication unit 522G transmits the transmission data via the antennaunit 521. Additionally, the communication unit 522G generates a signalfrom the radio wave received by the antenna unit 521. The generatedsignal is output from the communication unit 522G to the control unit121G.

The control unit 121G determines, based on the signal received from thecommunication unit 522G, whether or not there are a plurality of devicescapable of communicating with the wearable terminal 100G. If the controlunit 121G determines that there are a plurality of devices capable ofcommunicating with the wearable terminal 100G, the control unit 121G maygenerate a request signal for selecting a communication destination ofthe wearable terminal 100G. The request signal is transmitted to anetwork via the communication unit 522G and the antenna unit 521.

FIG. 15 is a schematic diagram illustrating an illustrative useenvironment of the wearable terminal 100G. A technique for selecting acommunication destination of the wearable terminal 100G will bedescribed with reference to FIG. 14 and FIG. 15. Numerals common to thetwelfth embodiment and the thirteenth embodiment designate componentshaving substantially the same features. Thus, these components areidentified using the description made in the twelfth embodiment.

FIG. 15 illustrates home electric appliances including television setsAP1 and AP4, an air conditioner AP2, and a washing machine AP3. Thebasic concept of this embodiment is not limited to a specific homeelectric appliance to be controlled.

The wearable terminal 100G is worn on the wrist of a user who is athome. Alternatively, the wearable terminal 100G may be worn on any otherportion of the upper limb of the user (e.g., the finger). The basicconcept of this embodiment is not limited to a specific position atwhich a wearable terminal is worn.

The antenna unit 521 of the wearable terminal 100G receives not only aradio wave from the smartphone 710 but also a radio wave from thetelevision set AP4. The control unit 121G is configured to determinethat the smartphone 710 and the television set AP4 exist as devices withwhich the wearable terminal 100G is capable of communicating. Similarlyto the twelfth embodiment, the communication between the wearableterminal 100G and the smartphone 710 may be based on near field radiotechnology (e.g., Bluetooth). Similarly, the communication between thewearable terminal 100G and the television set AP4 may also be based onnear field radio technology.

The control unit 121G generates a request signal for requesting that oneof the smartphone 710 and the television set AP4 be determined as acommunication destination. The request signal may be transmitted fromthe wearable terminal 100G to the cloud server 730 via the smartphone710. Alternatively, the request signal may be transmitted from thewearable terminal 100G to the cloud server 730 via the television setAP4.

The cloud server 730 may determine one of the smartphone 710 and thetelevision set AP4 as a communication destination on the basis of apredetermined determination standard. The cloud server 730 generates acommunication destination signal indicating the determined communicationdestination. The communication destination signal may be transmittedfrom the cloud server 730 to the wearable terminal 100G via thesmartphone 710. Alternatively, the communication destination signal maybe transmitted from the cloud server 730 to the wearable terminal 100Gvia the television set AP4.

Since the television set AP4 is connected to the home gateway 720 via awired local area network (LAN), the cloud server 730 may determine thetelevision set AP4 as the communication destination of the wearableterminal 100G because of the wide communication band. Alternatively, thecloud server 730 may determine the communication destination of thewearable terminal 100G on the basis of any other determination standard.The basic concept of this embodiment is not limited to a specificdetermination standard.

The user, instead of the cloud server 730, may determine thecommunication destination of the wearable terminal 100G. The controlunit 121G may display information concerning candidate communicationdestinations (in the use environment illustrated in FIG. 13, thesmartphone 710 and the television set AP4) on the display 131. The usermay operate the touch panel 132 and designate one of the smartphone 710and the television set AP4 as the communication destination of thewearable terminal 100G. Alternatively, furthermore, the candidatecommunication destinations may be displayed on the smartphone 710. Theuser may operate the smartphone 710 and designate one of the smartphone710 and the television set AP4 as the communication destination of thewearable terminal 100G.

At least one of the cloud server 730, the smartphone 710, and thewearable terminal 100G may have a function to determine a communicationdestination. Alternatively, the television sets AP1 and AP4, the airconditioner AP2, the washing machine AP3, and the home gateway 720 mayhave a function to determine a communication destination.

Fourteenth Embodiment

While the user operates a communication device located around a wearableterminal or as the user moves, the communication environment surroundingthe wearable terminal may change. It is therefore desirable that thecommunication destination of the wearable terminal be reset inaccordance with a change in communication environment. In a fourteenthembodiment, a technique for resetting a communication destination inaccordance with a change in communication environment will be described.

FIG. 16A and FIG. 16B are schematic diagrams illustrating anillustrative use environment of the wearable terminal 100G. A techniquefor changing the communication destination of the wearable terminal 100Gwill be described with reference to FIG. 14, FIG. 16A, and FIG. 16B.Numerals common to the thirteenth embodiment and fourteenth embodimentdesignate components having substantially the same features. Thus, thesecomponents are identified using the description made in the thirteenthembodiment.

FIG. 16A illustrates home electric appliances including television setsAP1 and AP4, an air conditioner AP2, and a washing machine AP3. Thebasic concept of this embodiment is not limited to a specific homeelectric appliance to be controlled.

The television set AP4 is selected as the communication destination ofthe wearable terminal 100G in accordance with the basic conceptdescribed in connection with the thirteenth embodiment. In this case,the user sets the communication scheme of the smartphone 710 to W-CDMAor LTE.

After that, the user changes the communication scheme of the smartphone710 to wireless fidelity (WiFi). As a result, a WiFi connection isestablished between the smartphone 710 and the home gateway 720.

The antenna unit 521 of the wearable terminal 100G receives a radio waveused for WiFi connection. As a result, the control unit 121G can sensethe change in the communication environment surrounding the wearableterminal 100G. The control unit 121G generates a request signal forrequesting the selection of the communication destination of thewearable terminal 100G. The request signal is transmitted to the cloudserver 730 via the communication unit 522G and the antenna unit 521.

The cloud server 730 is set so as to select a communication device witha wide communication band as the communication destination of thewearable terminal 100G. The WiFi connection between the smartphone 710and the home gateway 720 has a wider band than the communicationconnection between the television set AP4 and the home gateway 720.Thus, the cloud server 730 switches the communication destination of thewearable terminal 100G from the television set AP4 to the smartphone710.

Fifteenth Embodiment

Communication devices available as communication destinations of awearable terminal may be registered in advance in a cloud server.Priorities may be set in advance for the communication devicesregistered in the cloud server. In a fifteenth embodiment, a techniquefor setting a communication destination in accordance with the presetpriorities will be described.

FIG. 17 is a schematic diagram illustrating communication devicesregistered as communication destinations of the wearable terminal 100Gin the cloud server 730. A technique for setting the communicationdestination of the wearable terminal 100G will be described withreference to FIG. 14, FIG. 15, and FIG. 17.

FIG. 17 illustrates a smartphone A, a smartphone B, a car navigationsystem, a television set, and a home gateway. The smartphone A, thesmartphone B, the car navigation system, the television set, and thehome gateway are each configured to be connected to the wearableterminal 100G so as to be able to communicate with the wearable terminal100G using near field radio technology.

The cloud server 730 stores information (e.g., a communication address)on each of the smartphone A, the smartphone B, the car navigationsystem, the television set, and the home gateway. The cloud server 730selects the communication destination of the wearable terminal 100G fromthe smartphone A, the smartphone B, the car navigation system, thetelevision set, and the home gateway.

FIG. 18 is a table showing priorities set in the cloud server 730. Thetechnique for setting the communication destination of the wearableterminal 100G will further be described with reference to FIG. 14, FIG.15, FIG. 17, and FIG. 18.

As described in connection with the fourteenth embodiment, the wearableterminal 100G is configured to transfer information concerning thecommunication environment surrounding the wearable terminal 100G to thecloud server 730. The cloud server 730 may determine where the user is,using the information concerning the communication environment. If theinformation concerning the communication environment indicates thepresence of a radio wave from the car navigation system, the cloudserver 730 may determine that the user is in a vehicle. If theinformation concerning the communication environment indicates thepresence of a radio wave from the television set or the home gateway,the cloud server 730 may determine that the user is at home. If theinformation concerning the communication environment indicates thepresence of only a radio wave from the smartphone A and/or thesmartphone B, the cloud server 730 may determine that the user is awayfrom home. The wearable terminal 100G may have a global positioningsystem (GPS) function. In this case, the cloud server 730 may determinewhere the user is, based on GPS information from the wearable terminal100G. The basic concept of this embodiment is not limited to a specifictechnique for detecting where the user is.

In the setting of the priorities illustrated in FIG. 18, whendetermining that the user is in a vehicle, the cloud server 730 sets thecommunication destination of the wearable terminal 100G to the carnavigation system. When determining that the user is at home, the cloudserver 730 sets the communication destination of the wearable terminal100G to the television set. If the wearable terminal 100G is not in anenvironment where communication with the television set is possible, thecloud server 730 changes the communication destination of the wearableterminal 100G from the television set to the home gateway. If thewearable terminal 100G is not in an environment where communication withthe home gateway is also possible, the cloud server 730 changes thecommunication destination of the wearable terminal 100G from the homegateway to the smartphone A. When determining that the user is away fromhome, the cloud server 730 sets the communication destination of thewearable terminal 100G to the smartphone A. If the wearable terminal100G is not in an environment where communication with the smartphone Ais possible, the cloud server 730 changes the communication destinationof the wearable terminal 100G from the smartphone A to the smartphone B.

The priorities of the communication destinations may be set by the user.For example, the user may operate the touch panel 132 of the wearableterminal 100G and set and/or change the priorities of the communicationdestinations. Alternatively, the user may use a smartphone or any othercommunication device to set and/or change the priorities.

Sixteenth Embodiment

A wearable terminal that communicates with any other communicationdevice using near field communication technology (e.g., Bluetooth) willnot consume an excessively large amount of power for communication.However, a communication device capable of communicating with thewearable terminal may not necessarily be within a communication rangecovered by near field communication technology. Accordingly, thecommunication coverage area of the wearable terminal may be changed inaccordance with the use environment. In a sixteenth embodiment, awearable terminal configured to change its communication coverage areawill be described.

FIG. 19 is a schematic block diagram of a wearable terminal 100Haccording to the sixteenth embodiment. The wearable terminal 100H willbe described with reference to FIG. 18 and FIG. 19. Numerals common tothe thirteenth embodiment and the sixteenth embodiment designatecomponents having substantially the same features. Thus, thesecomponents are identified using the description made in the thirteenthembodiment.

Similarly to the thirteenth embodiment, the wearable terminal 100Hincludes a first integrated circuit 110, a user interface 130, amicrophone 200C, an antenna unit 521, a power supply unit 600F, and apower button 610. These components are identified using the descriptionmade in the thirteenth embodiment.

The wearable terminal 100H further includes a second integrated circuit120H. Similarly to the thirteenth embodiment, the second integratedcircuit 120H executes processes such as generation of transmission data,the control of the user interface 130, and user authentication. Theprocessing operation described in connection with the thirteenthembodiment is used to indicate the operation of the second integratedcircuit 120H.

Similarly to the thirteenth embodiment, the second integrated circuit120H includes an I/O section 122E, a timer 123, a storage unit 124, anauthentication unit 125, and an encoding unit 510C. These components areidentified using the description made in the thirteenth embodiment.

The second integrated circuit 120H further includes a control unit 121H,a switching unit 126, a first communication unit 523, and a secondcommunication unit 524. The wearable terminal 100H may performcommunication based on a first communication technology using acombination of the first communication unit 523 and the antenna unit521. The wearable terminal 100H may perform communication based on asecond communication technology using a combination of the secondcommunication unit 524 and the antenna unit 521. The switching unit 126selects a communication element to be used for communication, from thefirst communication unit 523 and the second communication unit 524.

The second communication technology ensures that transmission datareaches a wider range than the first communication technology althoughthe second communication technology requires a larger amount of powerthan the first communication technology. The first communicationtechnology may be exemplified by Bluetooth. The second communicationtechnology may be exemplified by WiFi.

As described with reference to FIG. 18, when the user is at home, thesmartphone A, the television set, and the home gateway may be set ascommunication destinations of the wearable terminal 100H. In this case,when the user is at home and all the smartphone A, the television set,and the home gateway are located largely away from the wearable terminal100H, the wearable terminal 100H may not be able to appropriatelycommunicate with the smartphone A, the television set, or the homegateway using the first communication technology. Using the secondcommunication technology instead of the first communication technology,the wearable terminal 100H may be able to communicate with at least oneof the smartphone A, the television set, and the home gateway.

FIG. 20A and FIG. 20B are schematic diagrams illustrating illustrativeuse environments of the wearable terminal 100H. The switching of thecommunication technology between the first communication technology andthe second communication technology will be described with reference toFIG. 19 to FIG. 20B.

When the power supply unit 600F supplies power to the second integratedcircuit 120H, the control unit 121H may generate image data to requestthe selection of one of the first communication technology and thesecond communication technology. The image data is output to the display131 via the I/O section 122E. The display 131 displays an image torequest the selection of one of the first communication technology andthe second communication technology using the image data. The useroperates the touch panel 132 and selects one of the first communicationtechnology and the second communication technology. Informationindicating the selected communication technology is output from thetouch panel 132 to the control unit 121H via the I/O section 122E.

If the user selects the first communication technology, the control unit121H controls the switching unit 126 to transmit the transmission datafrom the first communication unit 523. This allows the wearable terminal100H to transmit the transmission data to the home gateway 720 withoutconsuming a large amount of power.

If the user selects the second communication technology, the controlunit 121H controls the switching unit 126 to transmit the transmissiondata from the second communication unit 524. This allows the homegateway 720 located largely away from the wearable terminal 100H toreceive the transmission data.

The selection of the communication technology may not necessarily bedependent on the user operation. The control unit 121H may automaticallyswitch the communication technology in accordance with the communicationstate. For example, if the control unit 121H determines thatcommunication is not possible under the first communication technologyor if the control unit 121H detects an interruption of communicationunder the first communication technology, the switching unit 126 mayautomatically select the second communication technology. Alternatively,the control unit 121H determines that communication is not possibleunder the first communication technology or if the control unit 121Hdetects an interruption of communication under the first communicationtechnology, the user may be prompted to switch the communicationtechnology through the display 131. The basic concept of this embodimentis not limited to a specific method for switching the communicationtechnology.

The control unit 121H may limit the use period of the secondcommunication technology using the timer 123, if necessary. In thiscase, the wearable terminal 100H may not have excessively high powerconsumption.

Seventeenth Embodiment

A wearable terminal may access a cloud server without using a relaydevice such as a smartphone. In a seventeenth embodiment, a wearableterminal configured to access a cloud server without using a relaydevice such as a smartphone will be described.

FIG. 21 is a schematic block diagram of a wearable terminal 100Iaccording to the seventeenth embodiment. The wearable terminal 100I willbe described with reference to FIG. 21. Numerals common to the sixteenthembodiment and the seventeenth embodiment designate components havingsubstantially the same features. Thus, these components are identifiedusing the description made in the sixteenth embodiment.

Similarly to the sixteenth embodiment, the wearable terminal 100Iincludes a first integrated circuit 110, a user interface 130, amicrophone 200C, an antenna unit 521, a power supply unit 600F, and apower button 610. These components are identified using the descriptionmade in the sixteenth embodiment.

The wearable terminal 100I further includes a second integrated circuit120I. Similarly to the sixteenth embodiment, the second integratedcircuit 120I executes processes such as generation of transmission data,control of the user interface 130, user authentication, and theswitching of the communication technology. The processing operationdescribed in connection with the sixteenth embodiment is used toindicate the operation of the second integrated circuit 120I.

Similarly to the sixteenth embodiment, the second integrated circuit120I includes a control unit 121H, an I/O section 122E, a timer 123, astorage unit 124, an authentication unit 125, an encoding unit 510C, afirst communication unit 523, and a second communication unit 524. Thesecomponents are identified using the description made in the sixteenthembodiment.

The second integrated circuit 120I further includes a switching unit126I and a third communication unit 525. The switching unit 126I selectsa communication element to be used for the transmission of thetransmission data, from the first communication unit 523, the secondcommunication unit 524, and the third communication unit 525 undercontrol of the control unit 121H.

When the switching unit 126I selects the third communication unit 525,the wearable terminal 100I performs communication based on a thirdcommunication technology. The third communication technology ensuresthat transmission data reaches a wider range than the secondcommunication technology although the third communication technologyrequires a larger amount of power than the second communicationtechnology. The third communication technology may be exemplified by 3G.

When the switching unit 126I selects the third communication unit 525,the wearable terminal 100I can deliver the transmission data to a cloudserver without using a relay communication device such as a smartphone.Thus, a user who is away from home may be able to have remote control ofa home electric appliance without carrying a smartphone with them.

Eighteenth Embodiment

The user may give voice instructions to a wearable terminal to controlnot only a home electric appliance but also other devices. For example,if the user is able to have remote control of a smartphone by givingvoice instructions to a wearable terminal, the user will be able tocause the smartphone to operate without taking the smartphone out of thebag. In an eighteenth embodiment, a wearable terminal configured toallow remote control of not only a home electric appliance but alsoother devices will be described.

FIG. 22 is a schematic diagram illustrating an illustrative useenvironment of a wearable terminal 102 according to the eighteenthembodiment. The wearable terminal 102 will be described with referenceto FIG. 22.

Similarly to the various embodiments described above, the user is ableto have remote control of a home electric appliance network by givingvoice instructions to the wearable terminal 102. Accordingly, thetechniques for remote control of a home electric appliance networkdescribed in connection with the various embodiments described above areapplicable to the wearable terminal 102.

Unlike the various embodiments described above, the user is able to haveremote control of a smartphone by giving voice instructions to thewearable terminal 102. A technique for generating transmission data forthe remote control of a smartphone may be the same as a technique forgenerating transmission data for the remote control of a home electricappliance network.

When giving voice instructions, the user may have to say the name of thetarget device subject to remote control. In this case, giving voiceinstructions may bother the user. The technique for setting prioritiesdescribed in connection with the fifteenth embodiment contributes toovercoming a bothersome feeling that the user may experience.

FIG. 23 is a table showing priorities set in a cloud server. Thetechnique for remote control of home electric appliances and asmartphone will be described with reference to FIG. 22 and FIG. 23.

In the cloud server, a higher priority is given to a home electricappliance network than to a smartphone. As described in connection withthe fifteenth embodiment, the user may operate the wearable terminal 102to change the setting of the priorities.

If the voice instructions given by the user do not include the name of atarget device subject to remote control, in the setting of prioritiesillustrated in FIG. 23, a cloud server determines that the voiceinstructions are given to a home electric appliance network. Thus, theuser may only be required to give voice instructions including the word“smartphone” only when they wish to have remote control of a smartphone.

If the voice instructions given by the user do not include the word“smartphone” but include the function unique to a smartphone (e.g.,taking photographs), the cloud server may determine that the voiceinstructions have been given to a smartphone.

Nineteenth Embodiment

The user may possess a plurality of home electric appliances of the sametype. In a case where the user possesses two air conditioners, if theuser gives voice instructions that include the words “air conditioner”,it will be difficult for the cloud server to determine which of the twoair conditioners the user wishes to have remote control of.

The two air conditioners may be assigned unique names. In this case, theuser has to learn and memorize the unique names assigned to the two airconditioners. This may bother the user. In a nineteenth embodiment, awearable terminal configured to enable appropriate remote control of aplurality of home electric appliances of the same type will bedescribed.

FIG. 24 is a schematic diagram illustrating home electric appliancespossessed by a user. A technique for appropriate remote control of aplurality of home electric appliances of the same type will be describedwith reference to FIG. 24.

The user possesses a home gateway, a television set, a washing machine,an air conditioner (1), and an air conditioner (2). In existingtechniques, remote control of the air conditioner (1) and the airconditioner (2) is likely to experience the problems described above.The technique for setting priorities described in connection with thefifteenth embodiment contributes to overcoming the problems describedabove.

FIG. 25 is a table showing priorities set in a cloud server. Thetechnique for remote control of home electric appliances and asmartphone will be described with reference to FIG. 24 and FIG. 25.

Similarly to the fifteenth embodiment, the cloud server is configured todetermine where the user is. The user is configured to set a priorityfor each location.

While the user is away from home, “the air conditioner (1)” is one ofthe targets of remote control, whereas “the air conditioner (2)” is nota target of remote control. Thus, when determining that the user is awayfrom home, the cloud server can appropriately select “the airconditioner (1)” as a target of control.

While the user is at home, “the air conditioner (2)” is one of thetargets of remote control, whereas “the air conditioner (1)” is not atarget of remote control. Thus, when determining that the user is athome, the cloud server can appropriately select “the air conditioner(2)” as a target of control.

The user can set priorities in accordance with their own dailyactivities. If the user does not frequently use the washing machine, theuser may remove the washing machine from the target of remote control.

Twentieth Embodiment

A wearable terminal, a communication device responsible for the relay ofdata between the wearable terminal and a cloud server, and a homeelectric appliance may be designed to be capable of operating undercontrol of the cloud server. In this case, the cloud server preferablydetermines a target of control on the basis of the operation performedby the user. In a twentieth embodiment, a technique for determining atarget of control on the basis of the operation performed by the userwill be described.

FIG. 26 is a table for associating targets to be controlled by a cloudserver and operations performed by the user. The technique fordetermining a target of control on the basis of the operation performedby the user will be described with reference to FIG. 26.

When the user operates a power button of a wearable terminal and startssupplying power to the wearable terminal, the cloud server may determinethat the subsequent control instructions are given to the wearableterminal.

When the user operates a touch panel of a smartphone, the cloud servermay determine that the subsequent control instructions are given to thesmartphone.

When the user moves the upper limb on which the wearable terminal isworn, the cloud server may determine that the subsequent controlinstructions are given to a home electric appliance.

The basic concepts of the various embodiments described above may beused in combination to meet the request for the control of a homeelectric appliance.

The basic concept of the embodiments described above is suitable for usein the control of a home electric appliance.

What is claimed is:
 1. A wearable terminal configured to be wearable onan upper limb of a user and usable in a system for allowing remotecontrol of a home electric appliance device via a network by using voiceinstructions, the wearable terminal comprising: a voice data generationunit configured to generate audio data from the voice instructionsgenerator; a sensing unit configured to sense a motion of the upper limbin a first axis direction perpendicular to a plane defined by (i) asecond axis direction extending in a vertically downward orienteddirection of the upper limb and (ii) a third axis direction extending ina direction of movement of the user and being perpendicular to thesecond axis direction, and to generate motion data concerning themotion; a determination unit configured to determine, based on themotion data, whether or not the user is going to perform remote controlof the home electric appliance; and a data processing unit configured toprocess the audio data, the data processing unit including (i) atransmission data generation unit configured to generate transmissiondata corresponding to the audio data in a case where the determinationunit determines that the user is going to perform remote control of thehome electric appliance, and (ii) a transmission unit configured totransmit the transmission data to the network. sensor wearable on anupper limb of a user, the sensor being configured to generate motiondata after detection of motion of the upper limb, the motion dataincluding acceleration data indicating an acceleration of the upper limbin a first axis direction extending away from the user, the first axisdirection being perpendicular to a plane defined by (i) a second axisdirection extending in a vertically downward oriented direction of theupper limb and (ii) a third axis direction extending in a travellingdirection of the user and being perpendicular to the second axisdirection, and angular velocity data indicating an angular velocity of arotational motion of the upper limb around the second axis; and aprocessor configured to determine whether or not the acceleration of theupper limb in the first axis direction is larger than an accelerationthreshold, determine whether or not a rotation angle calculated from theangular velocity data is larger than a rotation angle threshold, causethe voice data generator to generate audio data from the voiceinstructions, when (i) the motion of the upper limb is detected, (ii)the acceleration of the upper limb in the first axis direction isdetermined to be larger than the acceleration threshold, and (iii) therotation angle calculated from the angular velocity data is determinedto be larger than the rotation angle threshold, the voice instructionsbeing inputted by the user, and start a processing of the generatedaudio data.
 2. The wearable terminal according to claim 1, wherein themotion data indicates an acceleration of the upper limb in the firstaxis direction, and when the acceleration is larger than an accelerationthreshold, the determination unit determines that the user is going toperform remote control of the home electric appliance.
 3. The wearableterminal according to claim 2, wherein the sensing unit is configured tosense an angular velocity of a rotational motion of the upper limb aboutthe second axis extending in the vertically downward oriented directionof the upper limb, and to generate angular velocity data indicating theangular velocity as the motion data, and the determination unitdetermines that the user is going to perform remote control of the homeelectric appliance when a rotation angle of the upper limb calculatedfrom the angular velocity data is larger than the rotation anglethreshold.
 4. The wearable terminal according to claim 1, furthercomprising a power supply unit supplier configured to supply power tothe data processing unit processor, wherein in a case where thedetermination unit determines that the user is going to perform remotecontrol of the home electric appliance, the power supply unit supplierstarts supplying the power to the data processing unit processor, onreceiving the trigger signal.
 5. The wearable terminal according toclaim 1, wherein the second axis direction extends along the upper limb,from shoulder to fingertip when the upper limb is extended, in thevertically downward oriented direction of the upper limb, and the thirdaxis direction extends in a direction across a hand of the userperpendicular to the second axis direction.
 6. A method for controllinga wearable terminal, with a sensor wearable to an upper limb of a user,configured to be wearable on an upper limb of a user and usable in asystem for allowing remote control of a home electric appliance devicevia a network by using voice instructions, the method comprising: asensing step of sensing a motion of the upper limb in a first axisdirection perpendicular to a plane defined by (i) a second axisdirection extending in a vertically downward oriented direction of theupper limb and (ii) a third axis direction extending in a direction ofmovement of the user and being perpendicular to the second axisdirection, and generating motion data concerning the motion; adetermination step of determining, based on the motion data, whether ornot the user is going to perform remote control of the home electricappliance; a generation step of receiving the voice instructions andgenerating transmission data corresponding to the voice instructions ina case where it is determined in the determination step that the user isgoing to perform remote control of the home electric appliance; and atransmission step of transmitting the transmission data to the network.generating motion data after detection of motion of the upper limb, themotion data including acceleration data indicating an acceleration ofthe upper limb in a first axis direction extending away from the user,the first axis direction being perpendicular to a plane defined by (i) asecond axis direction extending in a vertically downward orienteddirection of the upper limb and (ii) a third axis direction extending ina travelling direction of the user and being perpendicular to the secondaxis direction, and velocity data indicating an angular velocity of arotational motion of the upper limb around the second axis; determiningwhether or not the acceleration of the upper limb in the first axisdirection is larger than an acceleration threshold; determining whetheror not a rotation angle calculated from the angular velocity data islarger than a rotation angle threshold; causing the voice data generatorto generate audio data from the voice instructions, when (i) the motionof the upper limb is detected, (ii) the acceleration of the upper limbin the first axis direction is determined to be larger than theacceleration threshold, and (iii) the rotation angle calculated from theangular velocity data is determined to be larger than the rotation anglethreshold, the voice instructions being inputted by the user; andstarting a processing of the generated audio data.
 7. The methodaccording to claim 6, wherein the sensing step includes sensing anacceleration of the upper limb in the first axis direction, and thedetermination step includes comparing the acceleration with anacceleration threshold, and determining that the user is going toperform remote control of the home electric appliance when theacceleration is larger than the acceleration threshold.
 8. The methodaccording to claim 7, wherein the sensing step includes sensing anangular velocity of a rotational motion of the upper limb about thesecond axis extending in the vertically downward oriented direction ofthe upper limb, and the determination step includes comparing a rotationangle of the upper limb calculated using the angular velocity with arotation angle threshold, and determining that the user is going toperform remote control of the home electric appliance if the rotationangle is larger than the rotation angle threshold.
 9. The methodaccording to claim 6, wherein the second axis direction extends alongthe upper limb, from shoulder to fingertip when the upper limb isextended, in the vertically downward oriented direction of the upperlimb, and the third axis direction extends in a direction across a handof the user perpendicular to the second axis direction.
 10. The terminalaccording to claim 1, wherein a power supplier stops supplying the powerto the processor, when a predetermined period elapses after the powersupplier starts supplying the power to the processor.
 11. The terminalaccording to claim 1, wherein the processor is further configured togenerate transmission data corresponding to the generated audio data,and to transmit the transmission data to the network.
 12. The terminalaccording to claim 1, wherein the terminal is a wearable terminal. 13.The terminal according to claim 1, further comprising a displayconfigured to display information to the user, wherein the processorgenerates display data that indicates that the terminal becomesavailable to receive voice instructions, when the value of the motion inthe first axis direction is determined to exceed the threshold, and thedisplay displays the generated display data.
 14. A wearable terminalconfigured to be wearable on an upper limb of a user and usable in asystem for allowing remote control of a home electric appliance via anetwork by using voice instructions, the wearable terminal comprising: avoice data generator; a sensor wearable on the upper limb of the user,the sensor being configured to generate motion data after detection ofmotion of the upper limb, the motion data including acceleration dataindicating an acceleration of the upper limb in a first axis directionextending away from the user, the first axis direction beingperpendicular to a plane defined by (i) a second axis directionextending in a vertically downward oriented direction of the upper limband (ii) a third axis direction extending in a travelling direction ofthe user and being perpendicular to the second axis direction, andangular velocity data indicating an angular velocity of a rotationalmotion of the upper limb around the second axis; and a processorconfigured to after the motion of the upper limb is detected, determinewhether or not the user is going to perform remote control of the homeelectric appliance by (i) determining whether or not the acceleration ofthe upper limb in the first axis direction is larger than anacceleration threshold, and (ii) determining whether or not a rotationangle calculated from the angular velocity data is larger than arotation angle threshold, cause the voice data generator to generateaudio data from the voice instructions, when it is determined that theuser is going to perform remote control of the home electric appliance,the voice instructions being inputted by the user, start a processing ofthe generated audio data, and generate transmission data correspondingto the generated audio data, and transmit the transmission data to thenetwork.